Wearable device and method of controlling therefor

ABSTRACT

A method of controlling a wearable device according to one embodiment of the present specification can include the steps of displaying content on a display unit of the wearable device, sensing a tilt angle of the wearable device and providing a control interface providing control of the content. And, the step of providing the control interface can include the steps of mapping the control interface to the ground based on the sensed tilt angle and a state of the wearable device and displaying the mapped control interface on the display unit.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a Continuation of copending U.S. patent applicationSer. No. 14/477,330 filed on Sep. 4, 2014, which claims priority under35 U.S.C. §119(a) to Application No. 10-2014-0070218, filed in theRepublic of Korea on Jun. 10, 2014, all of which are hereby expresslyincorporated by reference into the present application.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present specification relates to a wearable device and a method ofcontrolling therefor.

2. Discussion of the Related Art

FIG. 1 is a diagram for one example of a wearable device.

Recently, a wearable device mounted on a body of a user is using. Forinstance, a head mounted display shown in FIG. 1 is one example of thewearable device. As depicted in FIG. 1, the wearable device may have aform similar to glasses. Hence, a user can always wear the wearabledevice.

The head mounted display can be classified into an open-view typeenabling a user to see a real object of a real world and a virtualreality image together and a closed-view type enabling the user to seethe virtual reality image only. The head mounted display with anopen-view can provide the user with enlarged immersion using AR(augmented reality) or MR (mixed reality).

FIG. 2 shows a situation that a user wearing a wearable device is notable to use both hands.

The wearable device can receive an input inputted by a hand. Forinstance, a user may control the wearable device by touching a bridgepart of the wearable device. Yet, as depicted in FIG. 2, if both handsof the user are not available, it is not easy to control the wearabledevice. Moreover, the user may simply want to control the wearabledevice without using both hands. In order to solve the aforementionedproblem, a method of controlling the wearable device by recognizing agaze of a user is studying. Yet, in a situation that there exists anexternal object, it is difficult for a user to fix a gaze of the user toa single point.

SUMMARY OF THE INVENTION

Accordingly, the present specification is directed to an apparatus andmethod thereof that substantially obviate one or more problems due tolimitations and disadvantages of the related art.

An object of the present specification is to provide a wearable deviceand a method of controlling therefor. In particular, the presentspecification intends to propose a more enhanced user interface in amanner of controlling the wearable device using a foot of a user.

Additional advantages, objects, and features of the invention will beset forth in part in the description which follows and in part willbecome apparent to those having ordinary skill in the art uponexamination of the following or may be learned from practice of theinvention. The objectives and other advantages of the invention may berealized and attained by the structure particularly pointed out in thewritten description and claims hereof as well as the appended drawings.

To achieve these objects and other advantages and in accordance with thepurpose of the invention, as embodied and broadly described herein,according to one embodiment, a wearable device includes a display unitconfigured to display one or more images, a movement sensing unitconfigured to measure at least one of speed and movement of the wearabledevice, an angle sensing unit configured to sense a tilt angle of thewearable device, an image sensing unit configured to sense one or morereal objects outside the wearable device and a processor configured tocontrol the display unit, the movement sensing unit, the angle sensingunit and the image sensing unit, the processor configured to displaycontent on the display unit, the processor configured to define at leastone real object among the sensed one or more real objects as an inputmeans, the processor, if the tilt angle of the wearable device is lessthan or equal to a first angle, configured to display a controlinterface providing control of the content on the display unit andterminate display of the control interface after a predetermined time,the processor, if the tilt angle of the wearable device exceeds a secondangle and the movement sensing unit determines that the wearable deviceis in a stationary state, configured to map the control interface to theground and display the mapped control interface on the display unit,wherein the control interface is controlled based on an input inputtedby the input means and wherein the first angle is less than or equal tothe second angle.

And, if the tilt angle of the wearable device exceeds the second angleand it is determined that the wearable device is in the stationarystate, the processor can define at least one of a foot and a shoe of auser of the wearable device as the input means.

And, when at least one of the foot and the shoe of the user of thewearable device is defined as the input means, if the image sensing unitsenses a hand of the user of the wearable device for more than apredetermined time, the processor can switch the input means to the handof the user.

And, if the image sensing unit senses feet or a pair of shoes of theuser of the wearable device, the processor can define a foot among thefeet or a shoe among a pair of the shoes of the user of the wearabledevice as the input means.

And, the processor can define the foot or the shoe as the input meansbased on at least one selected from a group consisting of apredetermined preferred value, frequency in use of each leg of the userof the wearable device and movement of the feet or a pair of the shoes.

And, the processor can display the mapped control interface adjacent tothe input means.

And, the control interface includes a plurality of images providing thecontrol of the content and the processor can determine arrangement of aplurality of the images based on a direction of the foot or the shoedefined as the input means.

And, the control interface includes a plurality of images providing thecontrol of the content and if the shoe of the user is defined as theinput means, the processor can determine at least one selected from agroup consisting of the image, arrangement of the image, a size of theimage and the number of image based on a type of the shoe.

And, the processor can determine the type of the shoe based on at leastone selected from a group consisting of a size of the sensed shoe, ashape of the shoe and a color of the shoe.

And, the processor can control a size of each of a plurality of theimages based on at least one of a size of the shoe and sharpness of anend of the shoe.

Meanwhile, if at least one of the foot and the shoe of the user of thewearable device is defined as the input means, the processor can limitan input inputted by an external real object except the input means.

Meanwhile, the input inputted by the input means is determined based ona gesture of the input means and the gesture can include at least oneselected from a group consisting of movement, hovering, holding, tappingand double tapping of the input means.

And, the control interface includes a plurality of images providing thecontrol of the content and an input for at least one image among aplurality of the images can be inputted by a predetermined gesture ofthe input means only.

Meanwhile, if the tilt angle of the wearable device exceeds the secondangle and it is determined that the wearable device is in the stationarystate, the processor can determine at least one of a display positionand a size of the control interface based on a condition of the groundsensed by the image sensing unit and the condition of the ground mayinclude at least one selected from a group consisting of a color of theground, continuity of the ground, height difference of the ground,flatness of the ground, inclination of the ground, material of theground, a sign on the ground and an external real object on the ground.

And, the processor detects at least one of an obstacle and a safetydanger based on the condition of the ground and can determine at leastone of the display position and the size of the control interface toavoid at least one of the detected obstacle and the safety danger.

And, if a distance between the input means and at least one of thedetected obstacle and the safety danger is greater than a predetermineddistance, the processor displays the mapped control interface. If thedistance between the input means and at least one of the detectedobstacle and the safety danger is less than the predetermined distance,the processor may not display the mapped control interface.

And, the processor detects stairs based on the condition of the groundand can display the mapped control interface on a position of thedisplay unit corresponding to a next step of a step on which the user ofthe wearable device is standing.

Meanwhile, if the tilt angle of the wearable device exceeds the secondangle and it is determined that the wearable device is in the stationarystate, the processor can display the mapped control interface on apredetermined position of the display unit or a position adjacent to thecontent.

Meanwhile, if the mapped control interface is displayed and the wearabledevice moves to the front or rear direction of the wearable device whilemaintaining a direction of the wearable device within the predeterminedtime, the processor can change a display size of the control interfacebased on a moving distance of the wearable device.

Meanwhile, if a speed of the wearable device is less than or equal to apredetermined speed or there is no movement of the wearable device, theprocessor can determine that the wearable device is in the stationarystate.

To achieve these objects and other advantages and in accordance with thepurpose of the invention, as embodied and broadly described herein,according to one embodiment, a method of controlling a wearable deviceincludes the steps of displaying content on a display unit of thewearable device, sensing a tilt angle of the wearable device andproviding a control interface providing control of the content. Thecontrol interface providing step includes the steps of if the sensedtilt angle is less than or equal to a first angle, defining one realobject among one or more real objects outside the wearable device as afirst input means, displaying the control interface on the display unitand terminating display of the control interface after a predeterminedtime. And, if the sensed tilt angle exceeds a second angle and it isdetermined that the wearable device is in a stationary state based on atleast one of speed and movement of the wearable device, the controlinterface providing step includes the steps of defining one real objectamong one or more real objects outside the wearable device as a secondinput means, mapping the control interface to the ground and displayingthe mapped control interface on the display unit. The control interfaceis controlled based on an input inputted by at least one of the firstand the second input means and the first angle may be less than or equalto the second angle.

According to the present specification, a wearable device can provide amore enhanced interface.

And, according to the present specification, a wearable device can sensea movement of the wearable device.

And, according to the present specification, a wearable device canprovide a control interface in relation to a real object of real world.

And, according to the present specification, a wearable device canprovide a safer control interface from safety danger of real world.

It is to be understood that both the foregoing general description andthe following detailed description of the present specification areexemplary and explanatory and are intended to provide furtherexplanation of the invention as claimed.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are included to provide a furtherunderstanding of the invention and are incorporated in and constitute apart of this application, illustrate embodiment(s) of the invention andtogether with the description serve to explain the principle of theinvention. In the drawings:

FIG. 1 is a diagram for one example of a wearable device;

FIG. 2 shows a situation that a user wearing a wearable device is notable to use both hands;

FIG. 3 is a block diagram of a wearable device;

FIG. 4 is a diagram for a case that a user wearing a wearable device isfacing the front;

FIG. 5 is a diagram for a case that a user wearing a wearable device isfacing the ground;

FIG. 6 is a diagram for a tilt angle of a wearable device;

FIG. 7 is a diagram for examples of a control interface mapped to theground;

FIG. 8 is a diagram for examples of a control interface based on shoes;

FIG. 9 is a diagram for explaining an operation of a control interfaceof a wearable device according to one embodiment;

FIG. 10 is a diagram for explaining an operation of a control interfaceof a wearable device according to a different embodiment;

FIG. 11 is a diagram for examples of a gesture;

FIG. 12 is a diagram for a control interface mapped to avoid a specificposition;

FIG. 13 is a diagram for a control interface mapped to stairs;

FIG. 14 is a diagram for a control interface based on a safety danger;

FIG. 15 is a diagram for a method of changing a size of a display of acontrol interface according to a movement of a wearable device;

FIG. 16 is a flowchart for a method of controlling a wearable deviceaccording to one embodiment;

FIG. 17 is a flowchart for a method of controlling a wearable deviceaccording to one embodiment.

DETAILED DESCRIPTION OF THE INVENTION

Reference will now be made in detail to the preferred embodiments of thepresent specification, examples of which are illustrated in theaccompanying drawings. While the embodiments have been concretelydescribed with reference to the attached diagrams and the contentswritten on the diagrams, a scope of claims may be non-restricted ornon-limited to the embodiments.

Although terminologies used in the present specification are selectedfrom general terminologies used currently and widely in consideration offunctions, they may be changed in accordance with intentions oftechnicians engaged in the corresponding fields, customs, advents of newtechnologies and the like. Occasionally, some terminologies may bearbitrarily selected by the applicant(s). In this case, the meanings ofthe arbitrarily selected terminologies shall be described in thecorresponding part of the detailed description of the specification.Therefore, terminologies used in the present specification need to beconstrued based on the substantial meanings of the correspondingterminologies and the overall matters disclosed in the presentspecification rather than construed as simple names of theterminologies.

And, structural or functional explanations, which are specified forembodiments according to a concept of the present disclosure, aredescribed to explain embodiments according to the concept of the presentspecification only. Hence, the embodiments according to the concept ofthe present specification can be implemented in various forms ratherthan construed as the embodiments explained in the present specificationonly.

Since the embodiments according to the concept of the presentspecification can have various modifications and forms, the presentspecification is explained in detail in a manner of showing examples ofspecific embodiments in drawings. Yet, the embodiments according to theconcept of the present specification may be non-limited to the specifieddisclosure form. Instead, the embodiments according to the concept ofthe present specification needs to be construed as the embodimentsincluding all changes, equivalents or substitutes included in an ideaand a technological scope of the present specification.

Moreover, a terminology, each of which includes such an ordinal numberas 1^(st), 2^(nd) and the like, may be used to describe variouscomponents. In doing so, the various components should be non-limited bythe corresponding terminologies, respectively. The terminologies areonly used for the purpose of discriminating one component from othercomponents. For instance, a 1^(st) component may be named a 2^(nd)component while coming within the scope of the appended claims and theirequivalents. Similarly, the 2^(nd) component may be named the 1^(st)component.

In the present application, such a terminology as ‘comprise’, ‘include’and the like should be construed not as necessarily excluding variouscomponents or steps written in the present specification but asincluding the components or steps in part or further includingadditional components or steps. And, such a terminology as ‘unit’written in the present specification indicates a unit processing atleast one function or an operation and can be implemented by hardware,software or a combination thereof.

FIG. 1 is a diagram for one example of a wearable device.

FIG. 1 shows a wearable device 100 of a glasses type. Yet, the wearabledevice 100 of the present specification can include such various typesof the wearable device as a helmet type wearable device, a cap typewearable device, a goggle type wearable device and/or a wearable devicecapable of being mounted on a head. In addition, the wearable device 100may include a contact lens or a smart contact lens including a display.The wearable device 100 can display one or more contents withoutblocking vision for an external object of the wearable device 100. Thewearable device 100 can provide augmented reality (AR) and/or mixedreality (MR) to a user.

FIG. 3 is a block diagram of a wearable device.

The wearable device 100 of the present specification can include adisplay unit 120 configured to display at least one image, a movementsensing unit 130 configured to measure at least one of a speed of thewearable device 100 and a movement of the wearable device, an anglesensing unit 140 configured to sense a tilt angle of the wearable device100, an image sensing unit 150 configured to sense at least one realobject outside the wearable device 100 and a processor 110 configured tocontrol the display unit 120, the movement sensing unit 130, the anglesensing unit 140 and the image sensing unit 150. Operations of thewearable device 100 disclosed in the present specification can also beperformed by the processor 110.

And, the wearable device 100 can further include a communication unit160 configured to communicate with an external device and a power supply170. Yet, the aforementioned configurations are not essentialconfigurations of the wearable device 100. For instance, the wearabledevice 100 can separately receive power from an external power supply.And, the wearable device 100 may further include differentconfigurations except the configurations depicted in FIG. 3. Forinstance, the wearable device 100 may further include a memory.Moreover, each of the configurations of the wearable device 100 can beconnected with each other via a bus 180.

The display unit 120 may include a lens, a plane of projection, aprojector and/or a prism. And, the display unit 120 may include anyother transparent display units. The display unit 120 may display anexternal image of the wearable device 100 in real time.

The movement sensing unit 130 can include an accelerometer, aspeedometer, a GPS (global positioning system), a gyro sensor, amagnetic field sensor and/or a proximity sensor. And, the movementsensing unit 130 can measure at least one of a speed and a movement ofthe wearable device 100 using the aforementioned image sensing unit 150.

The angle sensing unit 140 may include an accelerometer, a gyro sensorand/or a gravity accelerometer. The angle sensing unit 140 can sense atilt angle of the wearable device 100. The tilt angle of the wearabledevice 100 can be sensed on the basis of a user wearing the wearabledevice 100 facing the front direction. Hence, when the user is lookingat the ground, the tilt angle can be greater compared to a case that theuser is looking at the front direction. Yet, the tilt angle of thewearable device 100 can also be sensed on the basis of a gravitydirection. In this case, when the user is looking at the frontdirection, the tilt angle can be greater compared to a case that theuser is looking at the ground. As mentioned in the foregoingdescription, the tilt angle of the wearable device 100 can be measuredby various criteria. In the following, for clarity, assume that the tiltangle is sensed on the basis of the case that the user is looking at thefront direction. Yet, those skilled in the art can understand that thetilt angle can be sensed by various criteria, by which the presentspecification may be non-limited.

The image sensing unit 150 can sense a real object existing in externalof the wearable device 100. In particular, the image sensing unit 150can sense a real object existing in a direction at which a user of thewearable device 100 is facing. The image sensing unit 150 can sense animage using visible light, infrared light, ultraviolet rays, a magneticfield and/or sound waves.

In the foregoing description, the configuration of the wearable device100 is explained with reference to FIG. 1 and FIG. 3. In the followingdescription, operations of the wearable device 100 shall be describedaccording to the present specification. The operations of the wearabledevice 100 described in the following can be implemented by theaforementioned configuration (e.g., processor 110) of the wearabledevice 100.

FIG. 4 is a diagram for a case that a user wearing a wearable device isfacing the front.

Referring to FIG. 4, a user of the wearable device 100 is walking whilelooking straight ahead. Content 210 is displayed on a display unit ofthe wearable device 100. The content 210 can include at least one of astill image and a video. The user can start to display the content bycontrolling the wearable device 100. When the display of the content 210is started, a control interface 220, which provides the user withcontrol of the content 210, is displayed on the display unit of thewearable device 100. The wearable device 100 may be able to determinethat the user of the wearable device 100 is looking straight ahead bymeasuring a tilt angle of the wearable device 100.

And, the wearable device 100 can sense one or more real objects outsidethe wearable device 100 using an image sensing unit. The wearable device100 can define at least one real object from the sensed one or more realobjects as an input means. For instance, as depicted in FIG. 4, in casethat the user of the wearable device 100 is looking straight ahead, ahand of the user of the wearable device 100 may be defined as the inputmeans. The wearable device 100 may be able to define the hand of theuser of the wearable device 100 as the input means by recognizing ashape of the hand of the user of the wearable device 100 sensed by theimage sensing unit.

Meanwhile, the control interface 220 is controlled based on an inputinputted by an input means. The control interface 220 may include aplurality of images providing control of the content 210. For instance,the control interface 220 may include images providing such a control asa playback of the content 210, rewind, fast forward, stop, play from thebeginning and the like. Hence, if a hand of a user is defined as theinput means, the user can select a preferred control from the controlinterface by stretching out the hand to a corresponding image. Moreover,the user may control the control interface 220 by controlling otherinput means (e.g., a button or a touch pad positioned at a bridge of thewearable device 100) positioned on the wearable device 100. The controlinterface 220 can be dimmed. In particular, the wearable device 100 canterminate display of the control interface 220 after a predeterminedtime. And, if an input from the user is received, the wearable device100 can maintain the display of the control interface 220 as well.

Yet, as depicted in FIG. 4, if both hands of the user of the wearabledevice 100 are not available, it is very difficult for the user of thewearable device 100 to control the content 210 by hands.

FIG. 5 is a diagram for a case that a user wearing a wearable device isfacing the ground.

Referring to FIG. 5, content 210 is displayed on the display unit of thewearable device 100 and the user of the wearable device 100 pulled upand is looking at the ground. The wearable device 100 may be able todetermine that the user of the wearable device 100 is looking at theground in a manner of measuring a tilt angle of the wearable device 100.And, the wearable device 100 can determine whether the wearable device100 is in a stationary state by sensing a movement of the wearabledevice 100. For instance, the wearable device 100 can sense the movementof the wearable device 100 using a speed of the wearable device 100,acceleration of the wearable device 100, a movement of the wearabledevice 100 and/or an external image of the wearable device 100. And, ifthe speed of the wearable device 100 is lower than a predeterminedspeed, it may determine that the wearable device 100 is in a stationarystate. And, if there is no movement of the wearable device 100, it mayalso determine that the wearable device 100 is in the stationary state.

If the user of the wearable device 100 is looking at the ground and itis determined that the wearable device 100 is in the stationary state,the wearable device 100 maps the control interface 220 on the ground anddisplays the mapped control interface 220 on the display unit. If thecontrol interface 220 is mapped on the ground, the control interface 220is displayed like the control interface is drawn on the ground. Thewearable device 100 may display the control interface 220 near thecontent 210. And, the wearable device 100 can display the controlinterface 220 on a predetermined position of the display unit. And, asdescribed later, the wearable device 100 can display the controlinterface 220 on a position adjacent to an input means.

And, the wearable device 100 can sense one or more real objects outsidethe wearable device 100 using an image sensing unit. The wearable device100 can define at least one real object among the sensed one or morereal objects as an input means. For instance, as depicted in FIG. 5, incase that the user of the wearable device 100 is looking at the ground,shoes of the user of the wearable device 100 may be defined as the inputmeans. The wearable device 100 may be able to define the shoes of theuser of the wearable device 100 as the input means by recognizing ashape of the shoes of the wearable device 100 user sensed by the imagesensing unit. Moreover, the wearable device 100 may also define a feetof the user, crutches, a pole held by a hand of the user, a stick or anyother tools held by the user as the input means.

Meanwhile, the control interface 220 is controlled based on an inputinputted by an input means. The control interface 220 may include aplurality of images providing control of the content 210. For instance,the control interface 220 may include images providing such a control asa playback of the content 210, rewind, fast forward, stop, play from thebeginning and the like. Hence, if shoes of a user is defined as theinput means, the user can select a preferred control from the controlinterface by stretching out the shoes of the user to a correspondingimage. Moreover, the user may control the control interface 220 bycontrolling a different input means (e.g., a button or a touch padpositioned at a bridge of the wearable device 100) positioned at thewearable device 100. The wearable device 100 can continuously displaythe control interface 220 mapped on the ground while the wearable device100 is in the stationary state and the user is looking at the ground.The control interface 220 can be dimmed as the wearable device 100moves. Yet, although the wearable device 100 moves, the wearable device100 can continuously display the control interface 220. For instance,once the control interface is mapped on the ground and displayed, thewearable device 100 can continuously display the control interface 220while the user moves looking at the ground.

FIG. 6 is a diagram for a tilt angle of a wearable device.

As mentioned earlier with reference to FIG. 3, the wearable device 100can sense a tilt angle of the wearable device 100. The wearable device100 can determine whether a user is gazing at the front or the groundusing a range of a predetermined tilt angle. For instance, as shown inFIG. 6, a gaze direction of the user can be determined according to therange of the tilt angle. For instance, if the gaze direction of the useris less than a predetermined first tilt angle, the wearable device 100can determine it as the user is gazing at the front. And, if the gazedirection of the user exceeds a predetermined second tilt angle, thewearable device 100 can determine it as the user is gazing at theground. In this case, the first tilt angle may be less than or equal tothe second tilt angle.

For instance, if an axis facing the front of the wearable device 100 ishorizontal to a geoid surface, a tilt angle of the wearable device 100can be defined as 0 degree. And, as a head of a user is lowered, it maybe defined as the tilt angle is increasing. For instance, when the axisfacing the front of the wearable device 100 is heading to the ground andis orthogonal to the geoid surface, the tilt angle of the wearabledevice 100 can be defines as 90 degrees. And, the axis facing the frontof the wearable device 100 is heading to the sky and is orthogonal tothe geoid surface, the tilt angle of the wearable device 100 can bedefined as—90 degrees. Hence, as the axis facing the front of thewearable device 100 is heading to the ground, the tilt angle mayincrease. In this case, if the tilt angle is less than or equal to aprescribed angle, the wearable device 100 can determine it as the useris gazing at the front. For instance, if the tilt angle is less than orequal to 45 degrees, the wearable device 100 may determine it as theuser is gazing at the front. And, if the tilt angle exceeds a prescribedangle, the wearable device 100 can determine it as the user is gazing atthe ground. For instance, if the tilt angle exceeds 45 degrees, thewearable device 100 can determine it as the user is gazing at theground. In this case, 45 degrees can be replaced with a different value.

And, as mentioned in the foregoing description, the tilt angle can bedefined on the basis of a gravity direction. In this case, if the axisfacing the front of the wearable device 100 is heading to the ground andis orthogonal to the geoid surface, the tilt angle of the wearabledevice 100 can be defined as 0 degree. And, if the axis facing the frontof the wearable device 100 is heading to the sky, it can be defined asthe tilt angle is increasing. In this case, if the tilt angle exceeds aprescribed angle, the wearable device 100 can determine it as the useris gazing at the front.

As mentioned in the foregoing description, the tilt angle can varyaccording to a criterion of the tilt angle. Yet, for clarity, assumethat the tilt angle is increasing as the axis facing the front of thewearable device 100 is heading to the ground in the followingdescription.

FIG. 7 is a diagram for examples of a control interface mapped to theground.

The wearable device 100 can define shoes or feet of a user as an inputmeans. And, if feet or a pair of shoes of the user are sensed by theimage sensing unit, the wearable device 100 can define a foot among thefeet of the user of the wearable device 100 or a shoe among a pair ofthe shoes as an input means. For instance, the wearable device 100 candefine a foot or a shoe as the input means based on at least oneselected from a group consisting of a predetermined preferred value,frequency in use of each leg of the user of the wearable device 100 andmovement of the feet or a pair of shoes. For instance, a more frequentlyused foot (or a shoe) for the control of the control interface 220 or afoot (or a shoe), which has moved immediately before the controlinterface 220 is displayed, can be defined as the input means. Forinstance, among the feet (or a pair of the shoes), a foot (or a shoe)stayed a step ahead of the other can be defined as the input means.

Referring to FIG. 7, content 210 and the control interface 220 aredisplayed on the display unit of the wearable device 100. The controlinterface 220 is displayed in a manner of being mapped to the ground.Referring to FIG. 7, the wearable device 100 displays the controlinterface 220 in relation to a position of a pair of shoes. In FIG. 7,although an input means corresponds to a right shoe of the user of thewearable device 100, as mentioned earlier with reference to FIG. 5,various external real objects can be defined as the input means. Forinstance, a left shoe of the user of the wearable device 100 can bedefined as the input means as well.

FIG. 7 (a) is a diagram for one embodiment of the control interface 220.The control interface 220 includes a plurality of images providingcontrol of the content 210.

The wearable device 100 can determine arrangement of a plurality of theimages included in the control interface based on a foot or a directionof a shoe defined as the input means. Referring to FIG. 7 (b), thewearable device 100 makes an array of a plurality of the images inrelation to a right shoe of the user. For instance, as shown in FIG. 7(b), a plurality of the images can be lined up in a manner that aplayback image is to be near the right shoe.

And, the wearable device 100 can display the control interface 220 nearthe foot or the shoe defined as the input means. Referring to FIG. 7(c), the wearable device 100 displays the control interface 220 near theright shoe of the user. And, as depicted in FIG. 7 (d), the wearabledevice 100 can display the control interface 220 as a semicircle formadjacent to the input means. In this case, all of a plurality of theimages included in the control interface 220 can be displayed near theinput means.

FIG. 8 is a diagram for examples of a control interface based on shoes.

As mentioned in the foregoing description, the control interface 220 caninclude a plurality of images providing control of content 210. In casethat shoes of a user is defined as an input means, the wearable device100 can determine at least one selected from a group consisting of animage itself, arrangement of images, a size of images and the number ofimages based on a type of the shoes. And, the wearable device 100 candetermine the type of the shoes based on at least one selected from agroup consisting of a size, a shape, and color of the shoes. Hence, thecontrol interface 220 can be customized according to the type of theshoes defined as the input means.

Referring to FIG. 8 (a), the wearable device 100 determines the shoes ofthe user as men's shoes and can display the control interface 220corresponding to the men's shoes.

And, referring to FIG. 8 (b), high heels are defined as an input means.Referring to FIG. 8 (b), the control interface 220 includes more imagescompared to the control interface depicted in FIG. 8 (a). And, a size ofeach image is smaller than each image depicted in FIG. 8 (a). Inparticular, the wearable device 100 can determine the number of imagesin response to the type of shoes. And, the wearable device 100 maycontrol the size of the images included in the control interface 220based on at least one of size of shoes and sharpness of tip of shoes.

Meanwhile, a selection guide 230 is shown in the right of FIG. 8 (b).For instance, the selection guide 230 enables a user to select a type ofshoes defined as a current input means. Hence, the user can select thecontrol interface 220 which is customized according to each shoes in amanner of selecting the type of shoes using the selection guide 230.

Referring to FIG. 8 (c), sneakers are defined as an input means. Thewearable device 100 can display the control interface 220 includingimages corresponding to the sneakers. In particular, the wearable device100 can determine an image itself included in the control interface 220based on a type of shoes of a user.

Referring to FIG. 8 (d), slippers are defined as an input means. Forinstance, since an end of the slippers is rounded and is not comfortableto move, the wearable device 100 can display the control interface 220including less number of images. And, the control interface 220 can bedisplayed near the slippers in a circle form to make a user select animage with a smaller move.

And, the wearable device 100 may use shoes (e.g., slippers) as a marker.The wearable device 100 can display the control interface 220 adjacentto the shoes. A user takes off the shoes and may be then able to performan input for the control interface 220 with a foot. In this case, thewearable device 100 displays the control interface 220 near the marker(shoes) and may define the foot of the user as an input means.

FIG. 9 is a diagram for explaining an operation of a control interfaceof a wearable device according to one embodiment.

Referring to FIG. 9, shoes of a user is defined as an input means. Inthis case, a foot or a shoe of a passerby can be sensed by the wearabledevice 100. In order to prevent an input of the passerby from beingsensed, once at least one of the feet and the shoes of the user aredefined as the input means, the wearable device 100 can limit an inputinputted by an external real object other than the defined input means.

FIG. 10 is a diagram for explaining an operation of a control interfaceof a wearable device according to a different embodiment.

As mentioned earlier with reference to FIG. 5 and FIG. 9, the wearabledevice 100 can define feet or shoes of a user as an input means and canlimit an input inputted by an external real object except the inputmeans. Yet, as depicted in FIG. 10, the user of the wearable device 100may want to control the control interface 220 using a hand of the useragain. If the hand of the user is sensed by the image sensing unit formore than a predetermined time, the wearable device 100 can switch theinput means to the hand of the user. And, if a different input (e.g., aninput inputted via a button or a touch pad positioned at the wearabledevice 100) inputted by the hand of the user is received, the wearabledevice 100 may switch the input means to the hand of the user.

FIG. 11 is a diagram for examples of a gesture.

The wearable device 100 can be controlled based on an input inputted byan input means. And, the input inputted by the input means can bedetermined based on a gesture of the input means. For instance, thegesture can include at least one selected from a group consisting ofmovement, hovering, holding, tapping and double tapping of the inputmeans. The wearable device 100 may sense the gesture of the input meansusing the image sensing unit.

Referring to FIG. 11. The control interface 220 including a plurality ofimages and mapped to the ground is displayed. After feet or shoes of auser are defined as an input means, the user can control content 210 ina manner of performing a gesture for a preferred image. For instance,the user can perform a control corresponding to an image in a manner ofhovering the foot on the displayed image. Yet, in order to prevent theuser from inputting a wrong input, an input for the image can beinputted by a predetermined gesture only. And, some control for thewearable device 100 can be limited to be inputted by a physical inputonly. Meanwhile, if a gesture input is attempted for a limited control,the control may provide a guide indicating that a predetermined input(e.g., a physical input) is required.

Referring to FIG. 11 (a), a user taps a stop image of the controlinterface 220. An input for the stop image may be inputted by a tappingonly. And, an input for the stop/playback can be limited to be inputtedby a double tapping of the user only. Moreover, the wearable device 100may recognize an input only when a user holds a foot on a correspondingposition for more than a prescribed time after a tapping.

Referring to FIG. 11 (b), an input means (a shoe) is hovering on a fastforward image by a user. The wearable device 100 can continuously fastforward the content 210 while the hovering is maintained.

The gesture described in FIG. 11 is just an example A gesture of variousinput means can be used. And, gestures different from each other can beused according to a control type for the content 210. For instance,stop/playback may require a more complex gesture compared to a differentcontrol.

FIG. 12 is a diagram for a control interface mapped to avoid a specificposition.

When a control interface 220 mapped to the ground is displayed, thewearable device 100 can determine at least one of a display position anda size of the control interface based on a ground condition sensed bythe image sensing unit. And, the ground condition can include at leastone selected from a group consisting of color of the ground, continuityof the ground, height difference of the ground, flatness of the ground,inclination of the ground, material of the ground, a sign on the groundand an external real object on the ground. For instance, the wearabledevice 100 can sense the ground condition in a manner of measuring depthof the ground, color of the ground and the like.

Referring to FIG. 12, there exists a puddle on the ground. In this case,the wearable device 100 displays the control interface 220 in a mannerof avoiding the puddle. FIG. 12 shows an example of displaying thecontrol interface in a manner of avoiding something. The wearable device100 can detect at least one of an obstacle and a safety danger based ona sensed ground condition. For instance, the puddle depicted in FIG. 12can be classified into the obstacle and/or the safety danger. And, thewearable device 100 can determine at least one of a display position anda size of the control interface 220 to avoid a detected obstacle and/ora safety danger.

For instance, a point on the ground where a rapid inclination changeexists can be detected as an obstacle. Hence, the wearable device 100can display the control interface 220 in a manner of avoiding the pointdetected as the obstacle. And, the wearable device 100 may detect aprominent external real object (e.g., a foot of a different person onthe ground, a prominent block on the ground and the like) on the groundas an obstacle.

For instance, the wearable device 100 can detect a motoring road, acrosswalk, a sharp object on the ground, ice on the ground, a puddle onthe ground, a hole on the ground and the like as a safety danger.

FIG. 13 is a diagram for a control interface mapped to stairs.

Referring to FIG. 13, a user is in a stationary state while looking at afloor in the middle of going up the stairs. In this case, the wearabledevice 100 can detect the stairs based on the ground condition. Forinstance, the wearable device 100 may detect the stairs based ondiscontinuity of the ground or depth of the ground. And, the wearabledevice 100 can display the control interface 220 mapped to the ground ina position of the display unit corresponding to a next step of a step onwhich the user is standing.

Meanwhile, as depicted in FIG. 13, a hand of the user can be switched toan input means. Regarding this, it is identical to what is mentionedearlier with reference to FIG. 10. And, as an example, the controlinterface 220 can be mapped to the ground of steep inclination anddisplayed in the same ground. In this case, an input by the hand of theuser may become easier. Hence, the wearable device 100 can switch theinput means to the hand of the user or an object held by the hand of theuser. And, once the control interface 220 is displayed, the controlinterface can be continuously displayed although the user starts to moveagain. In this case, the wearable device 100 can receive an input whenthe wearable device 100 determines that the wearable device is in astationary state only. And, the wearable device 100 may receive an inputwhen the input means is switched from a foot or a shoe to a differentinput means (e.g., a hand of the user) only.

FIG. 14 is a diagram for a control interface based on a safety danger.

As mentioned earlier with reference to FIG. 13, the wearable device 100can detect at least one of an obstacle and a safety danger. And, if adistance between an input means and at least one of the detectedobstacle and the safety danger is greater than a predetermined distance,the wearable device 100 can display a control interface mapped to theground. And, if the distance between the input means and at least one ofthe detected obstacle and the safety danger is less than thepredetermined distance, the wearable device 100 may not display thecontrol interface mapped to the ground.

Referring to FIG. 14, a user is standing on a sidewalk to cross thestreet at a crosswalk.

Referring to FIG. 14 (a), if a control interface 220 is displayed, theuser may be in danger since the user should stretch out a foot of theuser to the motor road to perform an input for the control interface220. The wearable device 100 can detect a safety danger (e.g., acrosswalk or a motor road) based on at least one selected from a groupconsisting of color of the ground, height difference of the ground and asign on the ground (e.g., a crosswalk mark or a traffic lane mark).Referring to FIG. 14 (a), since a distance between an input means (afoot of a user) and the street is too close, the wearable device 100 maynot display the control interface 220.

Referring to FIG. 14 (b), the user takes a step backwards from thestreet. In this case, since a sufficient distance from a safety danger(e.g., a crosswalk or a motor road) is secured, the wearable device 100may display the control interface 220.

FIG. 15 is a diagram for a method of changing a size of a display of acontrol interface according to a movement of a wearable device.

Referring to FIG. 15 (a), a foot of a user is defined as an input meansand a control interface 220 is displayed. In this case, the user maywant to enlarge the control interface 220 to more easily control thecontrol interface.

Referring to FIG. 15 (b), the user takes a step backwards while facingthe front direction within a predetermined time after the controlinterface 220 is displayed. By doing so, the wearable device 100 candisplay the control interface 220 in a manner of enlarging the controlinterface. On the contrary, the user can reduce a size of the controlinterface 220 in a manner of taking a step forwards.

Hence, if the control interface 220 is displayed and the wearable device100 moves forward or backward of the wearable device 100 within apredetermined time while maintaining a direction of the wearable device100, the wearable device 100 can change a display size of the controlinterface 220 based on a moving distance of the wearable device 100.

Meanwhile, the wearable device 100 may share a controllability of thecontrol interface 220 with a different device. For instance, thewearable device 100 can perform mirroring with a different displaydevice. In this case, content 210 and the control interface 220 can bedisplayed on the different display device. If an input for the controlinterface 220 is received by the different display device, the content210 of the wearable device 100 may be controlled based on the input. Forinstance, the user of the wearable device 100 may want a different usersharing the content 210 to control the content 210 instead of directlycontrolling the content 210.

In the following, a method of controlling a wearable device according tothe present specification is explained. The method of controlling thewearable device described in the following can be combined with theconfiguration and operation of the wearable device mentioned earlierwith reference to FIG. 1 to FIG. 15.

FIG. 16 is a flowchart for a method of controlling a wearable deviceaccording to one embodiment.

The wearable device can display content on the display unit of thewearable device [1601]. As mentioned earlier with reference to FIG. 1and FIG. 3, the wearable device can display the content based on variousinputs. And, the wearable device senses a tilt angle [1602] and canprovide a control interface providing control of the content [1603].This can also be performed according to what is mentioned earlier withreference to FIG. 3 to FIG. 6. The method of controlling the wearabledevice depicted in FIG. 16 can be repeatedly performed. For instance,the wearable device continuously or periodically senses a tilt angle andcan provide a control interface in response to the sensed tilt angle asdescribed in the following.

FIG. 17 is a flowchart for a method of controlling a wearable deviceaccording to one embodiment.

The step (the step 1603 in FIG. 16) of providing the control interfacein FIG. 16 can include following steps. First of all, the wearabledevice compares the sensed tilt angle with a first angle or a secondangle [1701]. As mentioned earlier with reference to FIG. 6, the firstangle is less than or equal to the second angle. If a tilt angle is lessthan or equal to the first angle, it may be determined as a user islooking at the front. And, if the tilt angle exceeds the second angle,it may be determined as the user is looking at the ground.

Once it is determined that the tilt angle is less than or equal to thefirst angle, one real object among one or more real objects outside thewearable device is defined as a first input means [1702]. As mentionedearlier with reference to FIG. 4, for instance, a hand of the user canalso be defined as the first input means. And, the wearable devicedisplays a control interface providing control of content on the displayunit [1703] and can terminate the display of the control interface whena predetermined time elapses [1704]. As mentioned earlier with referenceto FIG. 4, the control interface can be dimmed or continuouslydisplayed.

Meanwhile, if it is determined that the tilt angle exceeds the secondangle, the wearable device determines whether the wearable device is ina stationary state [1705]. If the wearable device is not in thestationary state, the wearable device does not display the controlinterface. If it is determined that the wearable device is in thestationary state, the wearable device can define one real object amongone or more real objects outside the wearable device as a second inputmeans [1706]. As mentioned earlier with reference to FIG. 5, forinstance, a foot or a shoe of the user can be defined as the secondinput means. And, the wearable device maps the control interface to theground and can display the mapped control interface on the display unit[1707]. And, as mentioned earlier with reference to FIG. 7 to FIG. 16,the method of controlling the wearable device according to the presentspecification can change the mapped control interface based on variouscriteria. For instance, the wearable device can determine at least oneselected from a group consisting of a size, a shape and a position ofthe control interface based on at least one selected from a groupconsisting of a type of an input means, a position of the input means,an obstacle and a safety danger.

A wearable device according to the present specification and a method ofcontrolling therefor may not limitedly apply to the composition andmethod of the aforementioned embodiments. The aforementioned embodimentsmay be configured in a manner of being selectively combined the whole ofthe embodiments or a part of the embodiments to achieve variousmodifications.

Meanwhile, a wearable device according to the present specification anda method of controlling therefor can be implemented with a softwarereadable by a processor in a recording media readable by the processor,which is equipped in the display device. The recording media readable bythe processor may include all kinds of recording devices for storingdata capable of being read by the processor. The examples of therecording media readable by the processor may include a ROM, a RAM, aCD-ROM, a magnetic tape, a floppy disc, an optical data storing deviceand the like. The recording media readable by the processor aredistributed to the computer systems connected by a network and codesreadable by the processor can be stored and executed in a manner ofbeing distributed.

While the present specification has been described and illustratedherein with reference to the preferred embodiments and diagrams thereof,the present specification may be non-limited to the aforementionedembodiments and it will be apparent to those skilled in the art thatvarious modifications and variations can be made therein withoutdeparting from the spirit and scope of the present specification. Thus,it is intended that the present specification covers the modificationsand variations of this invention that come within the scope of theappended claims and their equivalents.

What is claimed is:
 1. A wearable device, comprising: a display unitcapable of displaying one or more images; a movement sensing unitcapable of measuring at least one of a speed or a movement of thewearable device; an angle sensing unit capable of sensing a tilt angleof the wearable device; an image sensing unit capable of sensing one ormore real objects; and a processor capable of controlling the displayunit, the movement sensing unit, the angle sensing unit and the imagesensing unit, wherein the processor is further capable of: firstlycontrolling the display unit to display content, and secondlycontrolling the display unit to display a control interface providingcontrol of the content depending on the tilt angle of the wearabledevice sensed by the angle sensing unit.
 2. A method of processing datain a wearable device, the method comprising: displaying one or moreimages in a display unit; measuring at least one of a speed or amovement of the wearable device; sensing a tilt angle of the wearabledevice; sensing one or more real objects; firstly controlling thedisplay unit to display content, and secondly controlling the displayunit to display a control interface providing control of the contentdepending on the sensed tilt angle of the wearable device.